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iWithout: support^ financial, organizational and 
otherwise, the U.S. national lEA writing^ study would never have been 
conducted; however , implementation of the^tudy difficult. 
Planning for_the-Study and itr f;upport commenced in 1980, coterminous 
with two important occurrencesj the National Institute of Education 
pulled-back on its interest in funding research in- the area of 
writing assessment at the Center for the Study of EValtiatioh (CSE) at 
UCLA and federal economic policies produced considerable shrinkage in 
federal and other funds available : for researeh^ CSE supported its 
design and planning phases^ Additional support for the design of the 
international study aiid test development was-provided by t 
University of Illinois, the Internationa^ Steering Committee, and the 
Spencer_Eoundation^-Since-CSE already had writing assessments 

in a-nun^r of -States, state funding was sought to continue 
independent programs, which were to serve as replicates. -Although the 
state support was not found to be fully compliant with lEA 

requirements, public pressure concerning writing competence 

lobbying by educators resulted in a largegrant fromthe MacArthur 
Foundation for data collection and trainingfor the scoring. Federal 
and state-ageheieszwere-helpful-in minimizing the data collection 
costs^ _ Additional-federal support was used for scoring and 
preliminary data analyses. Several factors were concluded to be^ 
significant: (1) professionals' commitment; (2) consideration of a 
variety of funding sources; (3) power of good data; ^4) value of 
cpliaboratipn among existing networks; and (5) collaboration with 
states and local school districts ^ (GDC) 
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Without support, financial, organizational and otherwise, 
the USA hatiohai lEA writing study would never have been 
conducted* Obviously. But while easy to say^ it was somewhat 
more difficult to implement. UCLA's strategy for securing 
support for the USA national lEA study v/as an exercise in 
patience^ persistence^ and penury. The process started in 1980 
and continues through today, a perpetual effort to assure funding 
for an large scale study during times of diminished research 
resources. The experience has provided a number of lessons in 
how to garner support, in the factors that contribute to success, 
in how to conduct research on a short shoestring, and in some of 
the costs as well as benefits from such a strategy. In my 
comments today, I'd like first describe the chronology of our 
experience and then to share some of the lessons we think we 
learned. 
Chronology 

_ j_ _ ... ^ - _ _ _ J '. 

Planning for the lEA study and its support coitTmenced in 

1980, coterminous with two important occurrences: NIE pulled 

back bh its interest in fiihdihg CSE research in the area of 
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writing assessment and federal economic policies produced 
considerable shrinkage in federal and other funds available for 
research. Thus, as we embarked on the iEA project, we lost the 
federal financial support for the very research capacity upon 
which the study was based and our options for pursuing other 
funding alternatives was somewhat constricted by the times. 

Nonetheless, we proceeded on with the design and planning 
for the study, supported in part by UCLA discretionary funds and 
in part by personnel commitments and donations. During the 
initial stages, the conceptual framework and study design for the 
international study was the primary concern, involving 
collaboration with Alan Purves at the University of Illinois and 
the full participation of an International Steering eommittee. 
Supported by the Spencer Foundation^ this international 
collaboration produced the design and instruments to be used for 
the study, including the writing tasks, questionnaires for 
students^ teachers^ and principals^ and scoring guides. 

As these plans became more cdherete, GSE's role became focused 
on the USA study and ways to support it. Securing funds to field 
and complete the study was a significant^ $500,000 problem. 
Perhaps equally irapoftaht, however, was continuing CSE's institu- 
tional capacity and presence in the area of writing assessment. 
Having lost federal support^ we needed to find an alternate 
market to maintain and build our research base. Having developed 
a highly refined and replicable set of procedures for assessing 
writing as a by product of our research oh writing, we found we 
had a product and process of great interest to local school 
districts and to state departments of education. Helping to 
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install writing assessments in such diverse places as Gohejo 
Valley^ Jurupa, Pittsburgh, Calif orhia^ iliihois. South Carolina, 
Connecticut (all principally Edys* efforts) resulted in a number 
of important benefits: 1.) we kept our capacity alive and our 
presence felt natiohaliy; 2.) we continued to refine the training 
and psychometric procedures which would later well serve the 
national study; 3.) we were able to conduct planned variations 
within these very practical applications that enabled us to 
expand our research base; and 4.) because the resulting 
assessments were well regarded, and in some cases cohtributad 
demonstrably to the improvement of student performance, we Wfsre 
able to expand political support for the national study and to 
document the importance of the methodology we were pfoposirjc' to 
implement. 

This experience suggested (to Eva) another potential way to 
support the lEA national study: a self -supporting model in which 
8-ld states would serve as replicates to compose the national 
sample and in which each state would support is own participation 
because of its inherent self interest (including interest/heed to 
conduct state assessments in writing and the capacity building 
opportunities the study involved for teacher/scorers and 
administrators ) . Thus while continuing to develop more 
traditional funding options during the period 1982-83 (through 
multiple contacts with the NIE, w±th the National Center for 
Educational Statistics, to foundations such as Carnegie 
Corporation, the keck Foundation, tt^e Department of Defense, the 
Ford Foundation, Exxon Foxindation, Weyerhauser Foundation, and 
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National Assessment, we (Eva) pursued negotiations with state, 
departments in Illinois^ Maryland^ Hawaii^ California, 
penhsi Ivania, Texas, and Virginia. On the verge of success 
with this latter^ self-supporting option, we were informed that 
this plan was not fully compliant with lEA requirements. 

At this point, we were near the end of our window of 
opportunity. According to the lEA plan, the last date for a 
country to carry out its data collectioh was the end of 1984 and 
here we were in 1984. A number of auspicious circumstances then 
intervened. First, enormous public policy interest developed 
around the issue of writing. An unprecedented number of national 
studies of the quality and needs of American education had been 
conducted and released. Almost Unanimously these studies 
concluded that writing was a significant skill related both to 
communication and to rational thinking and represented an 
important heed for American students. A number of these studies 
also supported the need for cross-hatiohai comparisons of the 
type exemplified by lEA work. Secondly, and probably more 
importantly, a number of academic colleagues intervened 
persdTially — through personal contact with fouhdatioh friends — 
to entourage funding of the study. As a result, the MacArthur 
foundation was willing to entertain a proposal to get the USA 
study off the ground. They were not willing or able to support 
the entire study, but they were willing to consider a $112, Odd 
grant with the proviso that other federal money be secured to 
augment their contribution. 

Given the methodological capability we were able to maintain 
and refine during the interim, the documentary base we had 



accuitimulated^ the political and public policy interest in the 
writing problem^ arid a real sense of urgency, we were able to 
develop a compelling and cost effective proposal for McArthur in 
which we could confidently proposed to field data collection and 
assure its return fay year's end. And that principally was what 
HacArthur was asked to support: data collection and training for 
the scoring. 

How were we able to launch and achieve the return rate we did 
in such a short time period? The support V7e had cultivated 
during the previous years played an important role. First, 
although NCES initially was not able to provide support, they did 
stand ready to help in drawing a national probability sample, a 
process that used their data base and their staff time. Second, 
contacts with the states in this project as well as through other 
personal and organizational networks had produced a good 
relationship with the Council of Chief State School Officers. 
Through their auspices, once the sample was drawn, we were able 
to solicit letters from the appropriate Chief to the district and 
schools drawn in the sample to encourage their participation. 
The letters added power to our requests for participation and 
probably contributed greatly to our return rate. From the 
teacher side too, we benefited from active support from the NEA. 
And from the practical side, it should be mentioned, we were 
offering teachers and schools something of real use, beyond the 
abstract value of contributing to research: a way to organize and 
look at their instructional programs in writing and data on how 
their students were performing relative to the nation and to the 
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iriterhat5.ohai community. 

With good data in haRd, but not gUite enough m5niy to 
complete the scoring, combined with eontihuihg policy interest in 
writing at the highest levels and pers5nal contacts > we were able 
to obtain in 1985 an increment from NIE/NCES. Committment from 
NIE and NCES management and program staff created this 
opportunity. The NCES funds enabled us to complete scoring on a 
sample students and classrooms across all tasks (scoring about 
1/2 the essays collected) and to d5 preliminary analyses. 
Preliminary scoring was completed during the summer of 1985, 
followed by the preliminary analyses Which Eva will address. 

And the search goes on. while we still ha-e a small amount 
of funds remaining to do additional analyses, we still lack the 
money to examine the school context and process data collected 
during the study and to examine relationships among and between 
context, process, and outcomes. We are seeking once more 
additional "modest allocation(s) to transform prior investments 
into even greater contribution^ - to provide a nationii 
portrait of students' writing in this country, to understand the 
nature of writing instruction as it currently exists, and to 
provide direction for future improvements in practice and policy. 
We are optimistic about our probabilities fbr success (and 
entertain some possibility of being included as a line item in 
the federal budget ) . 
Lessons Learned 

What have we learned from our experiences? Let me suramari2e 
briefly: 
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^fof^sSaliipT^.n^ ijidividMal 55^nent arid 

self-suppbttittrrtolel usLnfiJi"' :the__entire study., .the 

i-K -j^^ ^i^ir^^iv iux_otner research studies even thnnoh 

it^ did^not meet lEA needs. The incremental approach thit 
was_ ultimately used shows promise for funding oth^^^ llr^^ 
Er^l2?f-iL-!^- f-deli"are^ntK 



---- able to commit the total necessary. An incremental 
approach enables you to argue convincin|iy that £o? fult a 
rlauiedT°''^' ''''^ ^""^^^ ^^^^^ investments can bS 

eower of good data. : Related to point 2 haviho 
coiieJtid tS. r?^""^ amount-of funds and "^having 'act 5Iuy 
aetiS I; . • ^^l^' sound sampling and good return rates 

ifrl^ch availlblS f--^ing. Rather than trying thi 

lecL'Sarv f,^2^i ?J fully committed the 

fundinS^ iniii ^° ^^^^^^ ^ compelling data base for future 
lSSf?Irm ills. ^-onom^es might have had significant 

^ollalgatTg^ gf miting^networks and the importance of 
collaborat ion between researchers. prictiH^ ers sM 
poXicymaJcers to^gromote mutual goalsl B eing a]5e go 5r aw^ 
^ollfc^^^f^S'^S °' the: ^ Chiefs provided important moral? 
fSisfSS Inf''? support for the sludy - both for 

funding and for implementing the study. 

localP ^llggce^ d5ilaborative efforts with sta^ and 
ififi^nH 4=^ ? ''^^''^^^ °^ research to pHHtice at tKi 

state and^ local levels represents hot only a value in itself 
^- ^ maintaining institutional capacity and 

^^s^^^'^h I'^se. Particularly in^ times of 
reduced federal support for educational research, we need lo 
^^.^ partnerships and to explore hew creative 

- ^P""^?? '^^^^ Such endeavors can 

provide ^important political support for research as well as 
a means for funding it. 
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